Asymptotic entropy-constrained performance of tessellating and universal randomized lattice quantization
نویسندگان
چکیده
TWO resuhs are given. First, using a result of Csiszlr, the asymptotic (i.e., high-resolution/Iow distortion) performance for entropyconstrained tessellating vector quantization, heuristically derived by Gersho, is proven for all sources with finite differential entropy. This implies, using Gersho’s conjecture and Zador’s formula, that tessellating vector quantizers are asymptotically optimal for this broad class of sources, and generalizes a rigorous result of Gish and Pierce from the scalar to the vector case. Second, the asymptotic performance is established for Zamir and Feder’s randomized lattice quantization. With the only assumption that the source has finite differential entropy, it is proven that the lowdistortion performance of the Zamir-Feder universal vector quantizer is asympotically the same as that of the deterministic lattice quantizer.
منابع مشابه
Universal Deep Neural Network Compression
Compression of deep neural networks (DNNs) for memoryand computation-efficient compact feature representations becomes a critical problem particularly for deployment of DNNs on resource-limited platforms. In this paper, we investigate lossy compression of DNNs by weight quantization and lossless source coding for memory-efficient inference. Whereas the previous work addressed non-universal scal...
متن کاملWavelet-Based Image Coder with Entropy- Constrained Lattice Vector Quantizer (ECLVQ)
This paper presents an algorithm that jointly optimizes a lattice vector quantizer (LVQ) and an entropy coder in a subband coding at all ranges of bit rate. Estimation formulas for both entropy and distortion of lattice quantized subband images are derived. From these estimates, we then develop dynamic algorithm optimizing the LVQ and entropy coder together for a given entropy rate. Compared to...
متن کاملConditional weighted universal source codes: second order statistics in universal coding
We consider the use of second order statistics in two-stage universal source coding. (Examples of two-stage universal codes include the weighted universal vector quantization (WWQ) 12, 3, 41, weighted universal bit allocation (WUBA) [5, 41, and weighted universal transform coding (WUTC) [6, 41 algorithms.) The second order statistics are incorporated in two-stage universal source codes in a man...
متن کاملLattice/Trellis based Fixed-rate Entropy-constrained Quantization
The fixed-rate entropy-constrained vector quantizer draws its motivation from the large gap in the performance of the optimal entropy-constrained scalar quantizer (ESCQ) and the fixed-rate LMQ for most non-uniform sources and tries to bridge this gap while maintaining a fixed-rate output. Having a fixed-rate output avoids all problems associated with a variable rate output such as error propaga...
متن کاملAsymptotic Analysis of Multiple Description Lattice Vector Quantization
Recent results have shown that general K-channel multiple-description-coding (MDC) approaches often have significant advantages over conventional twochannel MDC methods. We provide new asymptotic results to describe the performance of a general K-channel symmetric MDC lattice vector quantizer (MDLVQ). We consider a memoryless L-dimensional source with probability density function f and differen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IEEE Trans. Information Theory
دوره 40 شماره
صفحات -
تاریخ انتشار 1994